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Background 

I n May 2008 the first National Assessment Program for Literaey and 
Numeraey (NAPLAN) tests were administered aeross Australia to deter- 
mine the standard of literaey and numeraey aehievement of Australia’s 
students in Years 3, 5, 7 and 9. 

The purpose of the tests is to provide information on student perfor- 
manee aeross four levels of aehievement in language eonventions and 
writing, reading and numeraey. Information gained from tests will support 
sehools and teaehers to plan for whole sehool and individual student 
improvement. Comparisons of student aehievement levels in literaey and 
numeraey may also be used to inform poliey-making and resoureing for 
sehools at both the national and state /territory levels. 

Students in years 3, 5, 7 and 9 sit a number of tests: 

For students In Years 3 and 5 NAPLAN testing eomprlses: 

• Literacy — a reading test, a language conventions test and a writing test. 

• Numeracy — a single test. 

For students In Years 7 and 9 NAPLAN testing comprises: 

• Literacy — a reading test, a language conventions test and a writing test. 

• Numeracy — two tests, one which requires students to use a calculator 
and the other that does not. 

AU Australian students take the tests under the same eonditions. The 
tests vary in length but range from 40 to 65 minutes. 

At the time of writing this paper, the seeond round of testing had just 
been eompleted. 

The purpose of this paper is to alert teaehers and sehool leaders to the 
nature of the NAPLAN numeraey tests and the implieations for their 
teaehing. It is not to suggest that teaehers “teaeh to the test” but rather that 
they eonsider what is being tested as indieated by the test eonstruetion. 
Teaeher retleetion on student results then beeomes a powerful tool to guide 
the teaehing of mathematies for numeraey attainment by students. 
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Mathematics or numeracy? 


In order to determine whether the NAPLAN Numeraey tests aetually assess 
mathematies or numeraey or both, we need a elear definition of numeraey. 
A plethora of definitions exist, many of them at odds with others. The 
MCEETYA definition is: “Numeraey is the effeetive use of mathematies to 
meet the general demands of life at sehool and at home, in paid work, and 
for partieipation in eommunity and eivie life” (MCEETYA 1997, p. 30). 

At a reeent meeting of national “experts” in this field, eonvened to inform 
the National Currieulum development, a draft revised definition was 
written: “Numeraey is the eapaeity, disposition and eonfidenee to use math- 
ematies to meet the general demands of sehool, home, work, eommunity 
partieipation and eivie life” (2 Mareh 2009). 

Willis (1992, p. 5) defined being numerate as “being able to use mathe- 
maties — at work, at home and for partieipation in eommunity or eivie life”. In 
1998 she further stated that people are eonsidered more or less numerate 
based on “how well they ehoose and use the mathematieal skills they have 
in the serviee of things other than mathematies” (Willis, 1998, p. 37). 

In a paper by The Australian Assoeiation of Mathematies Teaehers 
(AAMT, 1997, pp. 11-12) the following distinetion is made: 

Numeracy Is not a synonym for mathematics, but the two are clearly related. 

All numeracy Is underpinned by some mathematics; hence school mathe- 
matics has an Important role in the development of people’s numeracy... 
Further, while knowledge of mathematics Is necessary for numeracy, having 
that knowledge Is not In itself sufficient to ensure that learners become 
numerate. 

For the purpose of this paper, I use the AAMT definitions that derive 
fundamentally from Willis’ work, making a distinetion between mathe- 
maties as it is often pereeived by elassroom teaehers and the 
eommunity — and delivered in many sehools — as a set of de-eontextualised 
mathematieal faets and proeedures, and the ability to ehoose and use from 
these to suit the purpose and audienee. 

The dimensions of numeraey that need to be explieitly taught through 
relevant experienees (National Numeraey Review, 2008, p. 9) in sehools are 
three-fold: mathematieal, strategie and eontextual. 

Mathematieal numeraey is about mathematieal eontent; having number, 
measurement and spatial sense that derives from deeply understanding the 
mathematieal ideas and eoneepts and knowing proeedures and skills 
needed to apply these. For example, students know that the average (mean) 
of 16, 18 and 24 eannot possibly be 17 beeause they deeply understand that 
average is a measure of the ‘eentredness’ of a set of numbers; they know 
that 36 -r 0.3 ean’t possibly be a number less than 36 but must be approx- 
imately 3 lots of 36; they know that a whole number minus 1/2 and then 
1/3 will leave a small fraetion remaining beeause they ean visualise the 
amounts involved. 

Strategie numeraey and eontextual numeraey are about using mathe- 
matieal sense to deeide whether mathematies will assist in a situation and 
whether results obtained through subsequently applying the mathematies 
make sense in a partieular eontext. It ineludes having a disposition and 
attitude of eonfidenee, to ehoose and use mathematies when and where it 
is helpful to do so and to reason about those ehoiees. 

Mathematieal numeraey elearly dominates the N/VPL/VN Numeraey tests 
on two eounts; firstly beeause it is seen to be the most important of the 
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three numeraey dimensions, and seeondly beeause the nature of the test is 
not eondueive to students writing and justifying ehoiees of strategy or 
approaeh determined by eontext. 


Implications for testing 

It is diffieult to assess or determine numerate eapabilities through a pen 
and paper test, espeeially one titled “Numeraey Test.” The writers of the 
NAPLAN numeraey tests attempt to do this for some questions by deseribing 
hjqDOthetieal eontexts. These eontexts however, whilst demanding some 
higher -order skills and a eertain level of literaey, are limited in their 
eapaeity to assess the reasoning that is part of strategie and eontextual 
numeraey, sinee students are required primarily to “tiek the box” eontaining 
the eorreet answer. They are, at no time required to indieate the reasoning 
they use in obtaining a solution. 

A pen and paper test, partieularly a multi-ehoiee test, is unable to test 
reliably students’ eonfidenee and disposition to use mathematies. 
Limitations of multi-ehoiee questions inelude their inability to aseertain the 
meta-eognitive analysis underpinning student ehoiees of distraeters. This is 
essential if we are to test reliably the dimensions of numeraey listed above. 
Even if students get the eorreet answers, it is impossible to know whether 
they have used the reasoning strategies that we want students who are 
numerate to have, or if they have merely guessed. Henee the tests are also 
limited in their validity as we ean only assume they have reasoned and that 
their ehoiees are underpinned by numerate dispositions. 

It is my eontention that if students are being taught deep understand- 
ings of eoneepts — as distinet from methods, proeedures and algorithms that 
tend to dominate many mathematies lessons — they will have the eonfidenee 
and ability to apply their mathematieal understandings, resulting in 
numerate behaviours. Moreover, this will result in their being able to 
eomplete NAPLAN numeraey questions sueeessfuUy. 


Implications for teaching 

The depth of knowledge needed for mathematieal numeraey, as deseribed 
above, is based on informed reasoning that enables students to seleet 
eorreet responses for NAPLAN questions without undertaking speeifie 
eomputation in most eases. 

It is my opinion that students are best prepared to be sueeessful with the 
NAPLAN numeraey test by being taught to draw on the numeraey skills that 
best serve them in meeting the numeraey demands of life: estimation (based 
on deep understandings of mathematieal eoneepts), visualisation of eontext, 
and eommon sense. Some might argue that eomputational skills and 
routines are just as appropriate. However, for this partieular test genre and 
under these test eonditions, students will be more effieient if they utilise 
estimation skills sinee many question do not demand, or indeed require, 
eomputational skill. 

This has profound implieations for the teaehing and learning of mathe- 
maties in our sehools. Our primary aim is to teaeh the deep understandings 
that result in numerate behaviours; the direet spin-off from this is improve- 
ment in NAPLAN numeraey results. Consider the following question from 
the 2008 NAPLAN numeraey test: 
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This table summarises the tune Miek spent walking his dog over five days. 


TIME SPENT WALKING THE DOG 

Day 

Time 

Monday 

45 minutes 

Tuesday 

50 minutes 

Wednesday 

1 hour 

Thursday 

62 minutes 

Friday 

43 minutes 


What was the average (mean) time for these walks? 

(a) 40 minutes (b) 52 minutes (c) 65 minutes (d) 260 minutes 


The percentage of the total student cohort from the sample state who 
selected each of these responses was: 

(a) 11% 

(b) 59% 

(c) 10% 

(d) 19%. 

These results reveal a great deal about the degree of student understanding 
of the concept of average. Clearly, the students who selected the first, third 
and last responses (i.e., 40 minutes, 65 minutes and 260 minutes) do not 
understand the concept of average or they would have known at a glace that 
these three responses could not possibly be correct. 

Students who selected these three responses are likely to have attempted 
to calculate the correct solution using an algorithm rather than using some 
visualisation of the five daily times and their position on a number line with 
respect to each other — the method that 1 believe is most appropriate if 
mathematical numeracy is being used. 

By visualising these numbers on an unmarked number line as follows: 


40 45 50 55 60 65 

< N — 


> 


and knowing that the correct response must be a number that can be repre- 
sentative of the five numbers, students would be able to estimate the correct 
response as being between 50 and 55. Since there is only one distracter in 
this range, it must be correct. 

Significantly, because the students are given four numbers to choose 
from, an estimation is all that is required to be successful, and this esti- 
mation strategy is arguably the most efficient in this context. 

Unfortunately we are unable to determine whether the 59% of students 
in this state (and no doubt similar proportions in all states) who selected 
the correct response did so as a result of this deep understanding and visu- 
alisation or by using an algorithm. For the purpose of this test, an 
estimation is all that is required. Given the time available to complete the 
test paper, students should be taught to use the most efficient method, 
which is clearly estimation based on deep understanding. 

Being able to determine the purpose and audience from the context is 
part of critical numeracy, as is being able to determine the degree of error 
that can be tolerated. From my knowledge of our students nationally and of 
teaching practices in many classrooms, 1 suspect that most of the 59% who 
got this correct answer did so using a standard algorithm. Whilst not being 
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wrong, this would likely take students longer whieh would be ineffieient in 
this eontext. Certainty of this would reveal and eonfirm the limitations of 
NAPLAN numeraey tests in determining the numerate eapabilities of 
Australia’s students regarding their ehoiees of method and the appropriate- 
ness of the ehoiees for the eontext. Using the definition 1 have ehosen for 
this paper, 1 believe that a student using a standard algorithm in this 
eontext is less numerate. 

So as not to be aeeused of basing an argument on one example, 1 share 
another from the same test paper: 


A garden centre sells a potting mix made up of soil, compost and sand. Sand 
makes up | of the mix and compost makes up \ of the mix. What fraction of 
the potting mix is sand? 




The pereentage of the total student eohort from the sample state who 
seleeted eaeh of these responses was: 

(a) 19.1% 

(b) 48.7% 

(e) 13.4% 

(d) 17.2%. 

On examining these responses it beeomes elear that large proportions of 
Year 7 students aeross the eountry do not understand the eoneept of frae- 
tion, or at the very least, are unable to visualise fraetional amounts. Putting 
aside the literaey levels needed in order to understand the eontext and 
syntax of this question (see Newman, 1977), it is apparent that many 
students have at best partially understood these by the way they have 
responded. 

Students who seleeted 3/7 are those that deeided to add the two frae- 
tions to get the total amount of soil and eompost in the mix. Whether or not 
they understood that they needed to subtraet their answer from 1 is 
unknown. The faet that 48% of students merely added the two numerators 
and the two denominators is of greater a eoneern. Similarly, those who did 
know to subsequently subtraet their result from 1 — despite eorreetly deter- 
mining that two steps were needed — simply subtraeted 3/7 from 1 and 
obtained 4/7. 

All these students (i.e., the 48.7% and the 17.2%) have indieated in their 
response that they do not understand the relationship between the numer- 
ator and denominator of a fraetion. Neither do they, 1 would argue, 
understand the eoneept of fraetion sinee they were unable to visualise the 
quantities they were dealing with. If they had they would have known that 
if they added 2/3 and 1 / 4 of the same total quantity they would be left with 
a very small quantity from the whole amount. In other words, if they deeply 
understood that fraetion is about quantities of a whole and used that infor- 
mation to visualise the situation, they would know that of the four ehoiees 
presented, the solution eould only possibly be a small fraetion and sinee 
only one of the four possible distraeters, 1/12, is small, then this must be 
the eorreet response. 

It is elear from these results that fraetions are still being taught in many 
elassrooms as algorithms and proeedures only with little diseussion or visu- 
alisation and rarely embedded in real world eontexts that support the 
development of deep understandings of mathematieal eoneepts. For 
students to get these questions eorreet on NAPLAN tests these approaehes 
are essential. 
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Conclusions 


I recommend that every teacher of mathematics should undertake an 
analysis similar to that described here using their own data. 1 further 
recommend that they reflect on the outcomes of their analysis and share it 
with colleagues. Teachers can look at an individual student’s results, vari- 
ations in results between student sub-groups in their classes (e.g., gender, 
culture), and student responses to questions from different strands. 
Following this, some reflection — individually and collectively — on current 
teaching of mathematics for numeracy attainment should be considered. A 
key focus of this reflection and discussion is to question whether students 
are being taught the deep understandings of mathematics concepts and the 
capacity, confidence and disposition to use them, or are they merely taught 
mathematics as a system of methods and procedures set in a relatively 
neutral context. If the latter, teachers and school leaders need to be aware 
that they are seriously at risk of not giving their students access to 
numeracy attainment. We cannot assume that students will make the 
connections between methods and procedures and the conceptual under- 
standings needed for deep learning based on the fact that they’ve been 
taught the methods and procedures for finding answers. 
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